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Using a Probability Distribution Follower in MAS works 


Fernando Egido 
Independent Composer 
Busevin [at] gmail.com 

http://busevin.art 


In his paper | propose a formal definition of the concept of Probability Distribution Follower and a simple method, based on Monte Carlo Simulation 
Techniques, to implement it for discrete numbers. | will define a Probability Distribution Follower as a real-time random number generator that is 
able to fit any change in non-standard Probability Distribution over time. | will show the utility and the possibilities of integrating this algorithm in 
technological artistic works. Finally, | will explain how this algorithm was used in the work entitled “Transcognition”. In this work, | consider that a 
Cognitive Agent is collaborative when it follows the Probability Distribution of a database that stores all the notes created by the rest of the Cognitive 
Agents. The Probability Distribution of this database changes over time in an unpredictable way so this algorithm provides the way to follow the 


changes in real-time regardless of its mathematical definition. 


Keywords: Multiple cognitive agent, Algorithmic composition, Aleatory music, Monte Carlo Techniques. 


Using random numbers has been one of the key points in 
generating algorithm music. This is the reason why many 
different algorithms to create random numbers have been 
described and used in music. From the Aleatory works of 
Cage to the stochastics works of Xenakis, many forms of 
music have used a wide range of different forms of using 
and generating random numbers. One of the most signifi- 
cative definitions of random number generators is their 
Probability Distribution . 


Random numbers are a very important topic in Computer 
Science. A random number generator is considered good 
when we cannot predict any pattern in the numbers and 
they fit a uniform distribution. The mathematical defini- 
tion of random numbers and the metrics proposed to 
measure them are beyond the scope of this paper. | rec- 
ommend (Downey / Hirschfeldt 2010) for further insight 
into this topic. 


When | was composing Transcognition, | realized that | 
needed an algorithm that was able to produce random 
numbers, which followed real-time changing Probability 
Distribution. This was the reason why | implemented this 
easy algorithm. 


Computer Music literata provides several algorithms that 
are able to generate random numbers that fit a Probability 
Distribution. For example, we can find an example of an 
algorithm that fits a Gaussian Distribution in the classical 
book (Dodge / Jersey 1985). Gaussian or normal Distribu- 
tion is one of the most used Probability Distributions in 
Computer Music and Digital Art. 


The function that defines the Density Function of Gaussian 
Distribution is: 


f= cee |[-S] ow 
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And the algorithm that they proposed (written in C + +) 
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to generate random numbers that fit this Probability Dis- 
tribution is (Dodge / Jersey 1985: 349) 


Float gauss (float sigma, float mu) 
{ 
Float fran (); 
Int k; 
Int const N=12; 
Float const halfN=6; 
Float const scale=1; 
Float sum=0; 
For (K=1; k <= N; k++) 
Sum+=fran (); 
Return sigma*scale*(sum-halfN) +mu; 


} 


In this and other similar books we can find many algo- 
rithms that generate random numbers according to Prob- 
ability Distributions that can be defined mathematically 
via a Density Function. 


There are Probability Distributions that have a known 
Density Function, but there are many others that, at least 
apparently, do not fit any of these standard Density Func- 
tions. 


In artistic applications, we sometimes need to generate 
random numbers according to an unknown Density Func- 
tion. For example, we might want to create a work in 
which, instead of following a mathematically defined 
Probability Distribution, numbers fit an empirically gener- 
ated one, or the Probability Distribution of a database. For 
example, a composer might want a random number gen- 
erator that follows the Probability Distribution of the 
pitches in the work of Bach. Sometimes this kind of Prob- 
ability Distributions does not fit any standard or specific 
Known Density Function so we cannot use a concrete al- 
gorithm to produce Random numbers that follow these 
distributions. 
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The Monte Carlo Simulation Techniques are a set of tools 
and techniques that solve problems by generating re- 
peated random numbers. The Monte Carlo Simulation 
Techniques provide an algorithm that is able to create ran- 
dom numbers that follow a non-Standard Probability Dis- 
tribution. The only thing we need to do is to create a table 
that maps an index (i, ...., j) representing an event with the 
Probability P; associated with it. 


The use of Monte Carlo Simulation Techniques has a long 
history in musical applications. We can trace its use back 
to the very first Computer Music work. The Illiac Suite 
used it for the first time in 1956. The piece was composed 
by Lejaren Hiller and Leonard Isaacson using a Monte 
Carlo Method (Pareyon / Pina-Romero / Agustin-Aquino / 
Lluis-Puebla 2017: 244). 


The table must be normalized so the sum of all probabili- 
ties equals one. The algorithm used by the Monte Carlo 
Method is the von Neumann rejection technique (Neu- 
mann 1951). 


For the creation of random numbers according to any 
Probability Distribution normalized and mapped into a ta- 
ble,we can follow these steps: 


1. Generate two random numbers (a; ay) 


2. Obtain the probability of the index of the first random 
number p(a;). 


If Gp <p (a;) go to step 4 or else go to step 1. 


4. Return azas a valid random number that follows the 
Probability Distribution. 


No matter which Probability Distribution is represented in 
the table, the numbers that pass step 3 will fit that repre- 
sented by this table. 


But this is not a very efficient algorithm. For example, if 
we use this algorithm to generate random numbers that 
follow Gaussian Distribution, we will need to generate 
over 200 numbers until we find one that passes step num- 
ber 3 (that satisfies the formal condition to be considered 
as a valid random number for the purpose of this paper). 
If we use the Dodge algorithm, we will only need to create 
12. Therefore, if we need to create numbers according to 
a known, mathematically defined Probability Distribution, 
it is better to use a standard algorithm. Generating ran- 
dom numbers is a complex task that requires computa- 
tional time, so the fewer random numbers we need to use 
to create the desired aleatory numbers, the better the al- 
gorithm is. 


Definition 


The proposed definition is: a Probability Distribution Fol- 
lower is an algorithm (or any other thing) that is able to 
generate real-time random numbers that follow a Chang- 
ing Probability Distribution over time that does not neces- 
sarily have a Known Density Function. The term is inspired 
by the envelope follower. In the same way, an envelope 
follower is able to extract a feature from a signal that 


changes in time and returns the actual value of the fol- 
lowed parameter. 


We have a finite number of Probability Distributions that 
have a discrete and finite number of states represented in 
the set S. Each one of these states represents a concrete 
form of the mapped and normalized table. We have atime 
series (set T) each one representing the moment in which 
the random numbers are called. 


Formal definition 


We can define a Probability Distribution Follower as a 
structure composed of the elements below: 

Set of events E= {e; ..., ej} 

Set of index /= {i, ..., j} 

Set of probabilities of events P= {p, ..., pj 

Set of discrete random numbers A= {@z, ..., Gn} 

Set of pairs of random numbers 

PA= {(a; © AN Gy € Aju... (A; € AN Gy E A)n} 

Set of times T= {ty, ..., tn} 

Set of states of Probability Distributions at t € T 

S= {Sty oy St} 

Set of applications PS: — P that relates one of the in- 

dexes i; € with one of the p; € Pin the states s, € S 

PS= {DS pip +++) PStyh- 
We formally define a Probability Distribution Follower as 
an algorithm (or any other thing) that is able to generate 
pairs of random numbers {a; € A Aa, € A }€ PA at the 
time t € T that satisfies the condition: 


(2) 


Ap S ps¢(ai) 


Implementation 


One algorithm that implements this can be the following 
(in pseudocode): 
1. Begin the clock and wait until the first t; € Tcomes. 


2. When ¢; arrives obtain the state s, with the application 
ts,and store it in the buffer. 


Generate the table ps, from ts;and store it in a buffer. 
4. Generate two random numbers. (a; ap) 


Consult in the table ps; the probability of occurrence of 
the index a; (ptsq,). 


6. Ifa, > ptsq, go to step four and generate another pair 
t 
of random numbers otherwise go to step 7. 


7. Ifay S ptsg,Then return a, as a valid random number, 


izi++. 


Dp 


If i=n then go to step 10. 


Delete the buffers and go to 2 to generate the next num- 
ber. 


10. Finish. 
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Obviously, this algorithm can be used in constant or non- 
constant time intervals. For example, in the work entitled 
Transcognition, the Cognitive Agent uses the duration of 
the notes as a time interval. 


If we all wanted, we could create a timeframe to reset the 
database to the initial state in such a way that instead of 
using the total database of the numbers shown, we would 
only use a reduced timeframe. So, we would generate 
numbers that follow only the Distribution Probability fol- 
lowed by the numbers in this timeframe or temporal win- 
dow. 


Using Probability Distribution Follower in the 
work entitled Transcognition' 


Work Description 


Transcognition is a work composed in real-time that has a 
different function each time that the Max/Msp patch is 
launched. It is an open-form work created algorithmically. 
The audience will see the patch in the video (in figure 1 
you can see how the patch looks during the performance), 
the main window of the patch during the creation of the 
work. The patch has been programmed completely by the 
composer, without libraries or external sources. 


The title of this work is a concept created by Graeme L. 
Sullivan (Sullivan 2010). This concept was created as a 
thinking artist model. It describes artistic cognition as 
something that is very dynamic and changes very often, in 
which meanings change recursively in the very process. 
The way in which the artist creates the work makes the 
perceived environment mutable and therefore the cogni- 
tion of the work of art is transformed by the creative pro- 
cess itself. 


Transcognition is a visual arts process that knows that the 
forms, ideas, and situations are informing agents of the mind 
that surrounds the artistic self during the practice of visual 
arts. Transcognition is what happens when a creative pro- 
cess, which is closely related to a changing environment, 
changes itself in the same creative process. (Sullivan 2010: 
130) 


bot 24 becomes collaborative 
30 bots are in collaborative mode 


Figure 1. The main window of the Max/Msp Patch that shows which 
Agents are in collaborative mode. 
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This piece is created by 32 Multimodal Multiple Cognitive 
Agents (following the MAS paradigm (Wooldridge 2009). 
These agents have the capacity of creating music in com- 
petitive or collaborative modes (that is why the work is 
called Transcognition; at the same time, the environment 
changes in a constant evolving relationship). The work be- 
gins with all the agents in competitive mode. Each Agent 
creates its own music trying to generate the most inter- 
esting one to get the audience focused on its activity. 


This transcognitive process also makes the score a negoti- 
ation space among all Cognitive Agents. Each Agent pro- 
duces a single voice from a traditional perspective, creat- 
ing a 32-voice polyphony. 


In this work, competitive or collaborative modes are de- 
fined technically by following a different non-standard 
Probability Distribution that changes continually. 


The Work uses two different tables for each parameter, 
where the two different Distribution Probabilities are rep- 
resented. The competitive table can be considered the in- 
verse of the collaborative one. In figure 2 you can see the 
main sub-patch of the work in which all the Agents use the 
collaborative or competitive table, depending on their 
working mode, to generate musical events according to 
their internal state (collaborative or competitive). 


When they are in collaborative mode, Max/Msp stores 
each event occurring in a table. (This table is normalized 
in an auxiliary table). This table stores all the events that 
every cognitive agent has created to date. This database 
with all the event occurrences is converted into a Proba- 
bility Distribution by normalizing it each time that a new 
event arrives. In this way, all the Agents that are working 
collaboratively tend to repeat the most frequent notes. 


When they are in the competitive mode, they will use an- 
other table in which the probabilities are inverted so the 
index most likely to appear in the cooperative mode now 
has less probability. In other words, they will generate 
notes that are less used. 


This follows an interpretation of the Shannon Theory of 
communication (Shannon 1948), according to which the 
numbers least likely to occur are more significant. 


In this way, when the Agents are in competitive mode, 
they will try to generate the most significant note, trying 
to get the focus of the audience, while when they are in 
the collaborative mode, they will generate notes that are 
not significant but are the result of an implicit negotiation 
with the other Agents. 


The result of the progressive change of the work is a spe- 
cial narrative that arises from the fact that the Agents 
slowly enter the collaborative mode. So, while several 
Agents are negotiating, others still try to get the focus of 
the audience, but this number gradually decreases. At the 
end of the work, all the Agents are in the collaborative 
mode so the work slowly changes creating a sort of con- 
tinuous variation. At the same time, the Cognitive Agent 
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uses the score of the work itself as the vision of their real- 
ity. So, they interact with this micro-world that is created 
music. The agents see reality through the score of the 
work as a database while, at the same time, they react to 
this score and recursively the score changes according to 
the Agents’ reaction. In this way, we have constant inter- 
action between reality and the way the Cognitive Agents 
see it. That is the definition of transcognition. Agents are 
transformed by the very fact of creating the score of the 


work. 
et 


random #1 random 100 xdom # random 100 
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Figure 2. This sub-patch called followdistr implements in 
Max/Msp the described algorithm. If the Cognitive Agent is in 
collaborative mode, it uses the table collaborativescaled but if it 
is in competitive mode, it follows the table inverted. Those tables 
are shared by all Cognitive Agents. 


At the beginning of the work, all Cognitive Agents give 
their first note. The tables begin in a Uniform Distribution. 
Each Cognitive Agent has 6 sub-patches followdistr, each 
one related to a specific parameter of the work (duration, 
pitch, dynamic, timbre, envelope, spatial position). That is 
why we have two tables for each parameter (you can see 
this in figure 3). Every time a note finishes, a new one is 
created. 


Using Probability Distribution Follower 


For creating the database, each time that a Cognitive 
Agent generates a note it is stored in 6 different tables 
that form the overall database. In each one, a concrete 
parameter is stored. 


10 


event index Number of occurrences 
pp 1 1 
p 2 2 
mp 3 17 
mf 4 6 
f 5 1 
if 6 12 


Table 1. Database that stores the number of occurrences for each 
dynamic considered in the work. 


This table is normalized and converted into a Probability 
Distribution with the function. 


Xx, (3) 


In table 2 you can see table 1 normalized. 


index Probability 
1 0.0256 
2 0.0512 
3 0.4359 
4 0.1538 
5 0.0256 
6 0.3073 


Table 2. Probability Distribution of dynamics. This is the table used in 
collaborative mode collaborativescaled. 


To create the competitive table, table 1 is normalized with 
this function (probabilities are inverted). This table will be 
used in competitive mode. Other forms of converting ta- 
ble 1 into this were considered, but the resulting sound 
from this one was the best. This is, of course, arbitrary, 
and there is no specific or unique grounds for this. 


Max value of the table =mv 


pe nes (4) 
> (mv— X,) 
i=l 
index Probability 
1 0.2284 
2 0.2142 
3 0 
4 0.1570 
5 0.2284 
6 0.1714 


Table 3. Database that describes the Probability Distribution for the 
competitive mode inverted. 
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Changing to collaborative 


Each one of the Cognitive Agents believes that it is partic- 
ipating in a cooperative game to create music. They act as 
listening machines that have the possibility to listen and 
react to the overall score choosing whether they work in 
the competitive or in the collaborative mode. They are 
supposed to be intelligent enough to choose in which 
mode they will perform to create a better result. 


Periodically, each agent checks whether its work is really 
the most significant. If they decide not to, they become 
collaborative. Cognitive Agents have a metric based on the 
Theory of Communication (Shannon 1948), to measure 
significance, comparing their own part with the overall 
score. After several negative measurements, they become 
collaborative. Each agent object is instantiated with the 
agent number, the metric sensibility for mode changing 
and the frequency of the evaluation of the mode change. 


npetitive 


Figure 3. This part of the sub-patch, called agent that implements the 
Cognitive Agents shows the followdistr sub-patches. The followdistr sub- 
patches are instantiated with the cardinality of the E set and the number 
of the corresponding parameter (par1 to par 6). 


This uses a paradox. If each Cognitive Agent tries to get 
the Focus, the result is that none of them can actually get 
it, because the real result is very close to a Uniform Distri- 
bution in which any note is more significant. To do this, 
each Cognitive Agent periodically compares its own data- 
base with the general database of the work (their own 
voice with the general score) and if it thinks that what it is 
doing is significant, it continues in competitive mode, oth- 
erwise, it will enter the collaborative mode. Therefore, if 
the work is to become significant, the agent had better be- 
come collaborative. 


Finally, all Agents become collaborative. Two minutes af- 
ter the last Agent becomes collaborative, the work fin- 
ishes automatically. Once they become collaborative, they 
cannot return to the competitive mode. 


The input or contribution of the Cognitive Agent is the 
score. In this way, the generated score is converted into 
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the environment through which the Agents relate to each 
other. The role of the score itself is completely trans- 
formed in this work. Instead of being something closed 
that all Agents must follow, it is also the source of infor- 
mation that the Agents use to create their own music. The 
contribution of the Agents is exclusively the score (the da- 
taset of all the notes produced by all the Agents) that con- 
verts them into listening machines. The inner state of the 
Agents is changed by the score and, at the same time, they 
change and participate in it. 


Instead of a classical form, we have an open process form 
in which the sounding material changes according to the 
mode changing of the Agents. The work is constantly 
changing in an unpredictable way because the database 
(the score) changes completely according to whether the 
Agents become collaborative, so they are constantly imi- 
tating a different thing at all times. 


Conclusion 


Research in using random numbers in Computer Music 
works is still an open field that can arouse the composers’ 
imagination to provide new compositional strategies. Fur- 
thermore, the modelization of social agents into compu- 
tational Cognitive Agents permits a new form of sonifica- 
tion of social Processes. 


References 


Dodge, C. / Jersey, T. A. (1985). Computer Music: synthesis, 
composition, and performance. New York: Schirmer. 


Downey, R. G. / Hirschfeldt, D. R. (2010). Algorithmic 
Randomness, and Complexity. Berlin: Springer-verlag. 


Neumann, J. V. (1951). “Various techniques in connection with 
random digits’. Monte Carlo Method. Applied 
Mathematic series National bureau of standards 12/1: 
36-38. Washigton D.C.: US Government Prionting Office. 


Pareyon, G. / Pina-Romero, S. / Agustin-Aquino, O.A. / Lluis- 
Puebla E. (2017). The Musical-Mathematical Mind. Berlin: 
Springer-verlag. 


Shannon, C. €£. (1948). “A mathematical theory of 
communication”. The Bell System Technical Journal 27/3: 
379 - 423. 


Sullivan, G. (2011). “Artistic cognition and creativity”. The 
Routledge Companion to Research in the Arts. Michael, 
B./ Henrik, K. [Eds.]. Oxford and New York: Routledge. 


Sullivan, G. (2001). “Artistic Thinking as Transcognitive Practice. 
A Reconciliation of the Process-Product Dichotomy”. 
Visual Arts Research 27/1: 2-12. 


Sullivan, G. (2010). Art Practice as Research: Inquiry in Visual Arts. 
Thousand Oaks:Sage. 


11 


Fernando Egido - Using a Probability Distribution Follower in MAS works 


Wooldridge M. (2009). An Introduction to Multi Agent Systems. 
John Wiley and Sons. 


1 https://busevin.art/transcognition 


12 Emille, the Journal of Korean Electro-Acoustic Music Society Vol.17 (2019) 


HES O7|/& - BE/OMEAAMMASOA SS BE SAA Ab Sop] 


[Abstract in Korean | SZ 22F] 
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Ztctot BHHS ACOH, O|S BAS FH OMA. AAS SHS BH BANS HAZ oe EX MAAR 
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